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Introduction 
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y 


Our  aim  is  to  get  a  ^general  minimax  theorem”  whose  assumptions 

and  conclusions  are  phrased  only  in  terms  of  the  data  of  the  problem, 

i.e.  the  pair  of  pure  strategy  sets  S  and  T  and  the  payoff  function 

on  S  x  T.  For  the  assumptions,  this  means  that  we  want  to  avoid  any 

¥ 

assumption  of  the  type  ""there  exists  a  topology  (or  a  measurable 
structure)  on  S  and  (or)  T  such  that..."  For  the  conclusions,  we 
are  led  to  require  that  players  have  e -optimal  strategies  with  finite 
support ,  both  because  £hose  are  the  easiest  to  describe  in  intrinsic 
terms,  and  because  in  any  game  where  the  value  would  not  exist  in 
strategies  with  finite  support,  all  knovn  general  minmax  theorems 

y — 

implicitly  select  as  "value"^ either  the  sup  inf  or  the  inf  sup  by  in 
effect  restricting  either  player  I  or  player  II  arbitrarily  to  strategies 

y. — ■'  Ok-*'" 

with  finite  support  -  so  that  the  resulting  "value"  is  completely 
arbitrary  and  misleading.  ( 

Those  points  are  discussed  in  more  detail  in  Section  3,  after 
having  proved  a  first  theorem  in  Section  2. 


•This  research  was  supported  in  part  by  the  National  Science  Foundation  Grant 
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2.  A  First  Theorem 

Mi max  Theorem:  A  two  person  zero  sum  game  with  compact  strategy 
spaces  has  a  value  and  each  player  has  e-optimal  strategies  with  finite 
support  if  each  player's  payoff  is,  for  any  fixed  strategy  of  his 
opponent,  an  upper semi continuous  (u.s.c.)  function  of  his  strategy,  and 
is  hounded  either  from  above  or  frcm  below. 

[In  this  Section  2,  "compact"  means  compact  and  Hausdorff.] 

Proof:  Let  f  denote  the  first  player's  payoff  function,  S  his 
strategy  space,  and  T  his  opponent's  strategy  space.  For  any  pair  of 
mixed  strategies  a  and  t,  we  will  denote  by  f(o,t)  the  expectation 
of  f  under  the  corresponding  product  measure,  whenever  this  expectation 
is  unambiguously  defined  (via  Fubini's  theorem) . 

A  function  f  on  a  compact  space  K  is  u.s.c.  if  and  only  if 
f:  K  +  E  U  {-«}  and  V  a  G  R,  (x  J  f(x)  }  is  closed,  or  equivalently, 
if  and  only  if  f  is  the  pointwise  limit  of  a  decreasing  net  of  continuous 
real  valued  functions  on  K.  f  is  lower semi conti nous  (l.s.c.)  if 
and  only  if  -f  is  u.s.c..  Remark  that  if  f  is  l.s.c.,  then  f  is 
bounded  from  below,  so  each  player  guarantees  himself  a  finite  payoff 
with  any  pure  strategy. 

The  proof  starts  by  proving  particular  cases  of  the  statement; 
the  first  of  them  is  standard  and  is  just  recalled  for  the  reader's 


;V-y 


convenience. 
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(A)  Case  where  S  or  T  -say  T-  is  finite  (Von  Neumann). 


Proof:  Let  T  =  (t.,...,t  }  and  let  C  denote  the  closed  convex 
..  —  —  i  n 

set  (x  £  RD|3o  probability  on  S  (with  #  Supp(o)  <_  n  (Caratheodory)): 

Vi,  Jf(s,t. )do(s)  >  x.}.  Let  v  =  max  min  x  ;  then  V e  >  0, 

1  ~  x®  i  1 

[C  -  (v  +  e)]  n  R“  =  *  ,  so  that  for  a  separating  hyperplane  (X^,...,!^) 

we  have  sup  <X,y>  <0.  0,  and  also  by  normalizing  £x  =  1: 

y€C-(v+e)  1 

player  II  has  a  strategy  X  such  that  V  x  €  c,  <X  ,x>  <_  v  +  e.  When 
e  ■*  0,  we  get  by  compactness  a  strategy  X:  <X,x>  v,  V  x  S  C. 

(B)  Corollary:  Let  T  be  an  arbitrary  set,  f(s,t)  u.s.c. 

on  S  for  each  t  £  T.  Then  max  inf  f(o,x)  *  inf  max  f(o,x),  where 

a  t  x  a 

a  ranges  over  all  regular  Borel  probabilities  on  S  and  x  over  all 
probabilities  with  finite  support  on  T. 

Proof:  For  any  finite  subset  T  of  T,  let  £e  T  denote  the 

set  of  o's  satisfying  inf  f(c,t)  >,  inf  max  f(cr,x)  -  e.  By  (A), 

the  t  form  a  decreasing  net  of  non-empty  compact  sets,  so  have  a 

non-empty  intersection.  Any  in  the  intersection  yields 

inf  f(o  ,x)  =  inf  max  f(cr,x). 

T  u  x  a 

(C)  Case  where  one  of  the  strategy  spaces  -say  T-  is  metri sable. 

( i)  Claim:  f  is  Borel  measurable. 

Let  $3,...  be  a  dense  sequence  of  continuous  functions  on  T. 

Denote  by  the  closed  set  {s  |  K  t  G  T,  f(s,t)  _>  f^t)},  and 

let  ^(s.t)  *  4^(t)  for  s  €  *  -«  otherwise.  Obviously  is 

Borel  measurable,  and  therefore  also  f  »  sup  . 

i  x 


f  — . 


j'v 


(ii)  Denote  by  £  (resp.  T)  the  space  of  regular  Borel 
probabilities  on  S  {resp.  T),  and  by  (resp.  Tf)  the  probabilities 

with  finite  support. 

f  being  Borel  measurable  and  bounded  either  from  above  or  from 
below,  f (o  ,t  )  is  well  defined  on  ][  *  T  • 

By  (B),  there  exist  v  G  R  and  aQ  E  £  such  that 

f (o  ,t)  >  v  =  irf  sup  f{o,T)  Kt  GT 

°  ieTf  oe|f 

and  there  exist  v  E  R  and  tq  G  T  such  that 

f(s,x  )  <  v  =  sup  inf  f(o,T\  Vs  e  S  . 

0  “ 

On  the  one  hand,  one  has  always  v  *  sup  inf  <_  inf  sup  =  v,  on  the 

other  hand  one  gets  f(aQ,T^)  «  /f(<jQ,t)dTg(t)  v  >_  v  _>  /f(s,T0)do0(s) 

=  f{o0,t0),  and  thus  the  desired  equality  v  =  v. 

(D)  General  Case 

(i)  Construction  of  a  countable  set  of  best  replies. 

Let  v  *  ijjf  sup  f  ( o ,  t  ) ,  and  let  f  denote  those  t£f.  with 

if  It  "  f 

#  Supp  (t)  <_ n.  Denote  also  by  F  the  set  of  continuous  functions  $ 
on  T  for  which  there  exists  s  €  s  such  that  f(s,t)  (t)  V  t  €  T: 
then  v  <  inf  sup  /  $dt. 

"t€|„ 

**eF  ,  let  O^-lteTJMteT-i)  . 


— 1 
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each  fixed  k  and  n,  an  open  covering  of 

*,  denote  a  finite  subset  of  F  such 
k,n 

a  countable  subset  of  F,  such  that 

(C). 

let  dft^tg)  *  J2-1  |  ^(t^  -  ♦i(tSj)l/l#1l. 

d  defines  a  metrisable  quotient  space  T  of  T,  such  that,  if  ip 

denotes  the  quotient  mapping,  any  ♦£}  can  be  written  as  g  o 

for  seme  g  €  C(T)  -  where,  for  sane  s  £  S,  (go  i|>)(t)  £  f(s,t) 

Vt  €  T.  Let  'f  denote  the  set  of  all  g  G  C(T)  having  this  property. 

Define  f  on  S  x  T  by  f(s,t)  *  sup  (g(t)  (  g  €  C(T), 

(go  i p){ .)  <_  f  (s, .)} .  Then,  from  (i) ,  v  =  irrf  sup  J  <t>dt  <_  inf 

.  .  if  'f’54’  T^Tf 

sup  /(go  i|»)(t)dT(t)  £  _inf  sup  /  f(s,t)dt{t).  Obviously  f  is  l.scc. 

8^  .  T<E?f  s€3> 

on  T  for  each  s  €  S,  and  is  the  largest  such  function  satisfying 
f(s,i|»(t))  <_  f(s,t) . 

Let  h(s,t)  =  inf  (f(s,t)  |  t  e  1  ( t ) J :  if  we  show  that  h(s,t) 

is  l.s.c.  on  T  for  each  s  e  S,  it  will  follow  that  f  *  h,  and 
therefore  that  f  is  also  u.s.c.  on  S  for  each  t  €  T  -  as  an  infimum 
of  u.s.c.  functions. 


The  0.  .  form,  for 
9,&,n 

the  compact  space  TQ.  Let 

that  U  0  =  T  . 

„  *»k»n  n 

Then  *■*->*  is 
k,n  k‘n 

v  *  inf  sup/^dt. 


(ii)  Reduction  to  Case 
If  enumerates  * , 


Since  T  is  metrisable,  denote  by  ti  a  sequence  converging 
to  t„.  Choose  t^  ^  T  such  that  ♦(t^)  *  t^  and  f(s,tj)  h(s,tj)  +  1/i, 
and  let  t^  be  a  limit  point  of  t^:  we  have  ^(tw)  *  tw,  and 


hfs.t^)  <_  fCs.t^)  <_  lim  inf  f(s,t^)  lim  inf  hCs,^)  -  hence  the  result. 

±-*ca  i-H» 

(iii)  Conclusion. 

f  on  S  *  T  satisfies  all  assumptions  of  (C),  and  from  (ii)  we 
have  f(s,i|>(t))  <_f(s,t)  and  v  <_  inf  sup  /  f(s,t )dr(t ) . 

■?ejf  sGs 

From  (C),  we  know  therefore  that 

v  <_  sup  inf  J  f(s,t)do(s)  <  sup  inf  f(a,t)  , 

o^f  t£T  o€j;f  ter 

which  completes  the  proof,  the  reverse  inequality  being  obvious. 

3.  Comments  on  the  Present  Result 

(i)  The  compactness  assumption  on  both  sides  is  really  needed,  as 
the  following  example  due  to  H.  Kuhn  shows  (private  communication  through 
R.J.  Aumann,  example  originates  from  Kuhn’s  "Lecture  Notes  in  Game  Theory" 
[  ~19**9] ,  unpublished) . 

Player  I  picks  a  number  x  in  [0,l],  and  player  II  chooses  a 
continuous  function  <l>  from  [0,l]  to  itself  vith  />Kt)dt  =  1/2. 

The  payoff  is  ♦(x).  Then  player  I  can  guarantee  1/2  by  choosing  x 
uniformly  distributed  and  player  II  by  taking  ♦(t)  =  1/2  ¥t.  But  for 
any  strategy  of  I  with  finite  support,  player  II  can  choose  an  appropriate 
♦  that  vanishes  on  the  support  -  so  player  I  cannot  guarantee  more  than 
zero  using  strategies  with  finite  support. 

Remark  here  that  if  player  II’ s  strategy  space  is  endowed  with 
the  uniform  topology,  we  have  a  compact  metric  strategy  space  for  player 
I,  and  a  complete  separable  metric  for  II,  and  the  payoff  is  uniformly 
bounded  and  a  uniformly  continuous  function  of  player  II’ s  strategy  - 


in  particular  it  is  Jointly  continuous  on  S  x  T:  even  with  much 
stronger  assumptions  everywhere  else.  Just  the  failure  of  the  compactness 
assumption  on  one  side  makes  the  theorem  break  down. 

(ii)  TVo  directions  of  extension  seem  conceivable: 

-  The  first  would  rely  on  some  idea  that  our  whole  line  of  proof, 
of  reducing  oneself  to  seme  case  where  Fubini's  theorem  could  be  applied, 
is  artificial,  and  that  Fubini's  theorem  is  irrelevant  for  this  problem. 

In  that  case,  one  ought  to  be  able  to  remove  from  the  assumptions  the 
last  trace  of  Fubini's  theorem  -  i.e.  that  the  payoff  function  be 
uniformly  bounded  either  from  below  or  from  above,  and  one  might  try 

to  extend  this  to  seme  "intrinsic"  setting,  i.e.  essentially  drop  the 
assumption  that  the  strategy  spaces  are  Hausdorff,  and  Just  ask,  using 
Alexander’s  subbase  theorem,  that  the  family  of  sets 
S  =  {s  €  S  |  f(s,t)  ^  a}  (t  €  T,  o  G  R)  has  the  finite 
intersection  property,  and  similarly  for  Player  II. 

-  The  other  direction  would  on  the  contrary  look  at  Fubini’s 
theorem  as  being  basic,  and  consider  that  the  "good"  minmax  theorem  is 
the  corollary  sub  (B)  in  the  proof  (from  which  all  other  minmax  statements 
are  easily  obtained  as  corollaries  -  cfr.  Section  1*).  So  one  would  try 

to  show  that,  for  any  payoff  function  satisfying  the  assumptions  of  the 
theorem,  Fubini's  theorem  applies  for  any  product  of  regular  Borel 
measures.  Then  the  theorem  would  become  an  immediate  corollary  of  the 
statement  sub  (B).  Furthermore,  this  would  be  a  much  more  flexible  tool, 
in  conjunction  with  the  methods  mentioned  in  Section  l*,  using  the 
stability  properties  of  the  set  of  functions  that  are  measurable  for 


any  product  of  tight  probabilities  (pointvise  limits,  algebraic  operations, 
composition,  etc.). 

Hie  best  result  we  know  in  this  direction  requires  however, 
f(s,t)  to  be  continuous  in  each  variable  separately  (and  implies  then, 
whenever  S  and  T  are  Hausdorff  spaces,  that  f  is  measurable  for 
any  tight  probability  on  S  *  T  -  cfr.  Bourbaki  ([  19591  §2,  ex.  26). 

It  is  by  the  way  the  basic  idea  of  a  fundamental  lemma  underlying  this 
theorem  (that  points  in  the  closure  of  sane  set  in  C(K)  are  already 
in  the  closure  of  some  countable  subset  of  it)  that  we  have  used  in 
part  ( D) ( i )  of  the  proof. 

(iii)  Motivations  for  this  type  of  theorem  are  multiple. 

(a)  There  is  first  the  aesthetic  motivation  of  obtaining  the 
minmax  theorem  for  mixed  strategies  under  such  assumptions  that,  by 
Just  adding  the  quasi-concavity-quasi-convexity  assumption,  one  obtains 
Sion's  assumptions  for  the  existence  of  pure  strategy  solutions  (adding 
a  boundedness  assumption  to  Sion's  does  not  weaken  his  theorem). 

(b)  There  is  also  the  "effectiveness"  point  of  view,  that  only 

discrete  random  variables  can  be  effectively  generated  in  finite  time. 

(Any  such  discrete  r.v.  can  be  generated  with  a  fair  coin,  by 

generating  by  successive  tosses  the  successive  bits  of  seme  random 

number  x  (0  <_x  <  1),  stopping  as  soon  as  it  is  clear  that,  for  seme 

n,  \  p,  <  x  <  ^  p  and  deciding  then  in  favor  of  the  n-th  outcome: 
i<n  ~  i<n  1 

clearly  a  decision  will  be  reached  a.s.  in  finite  time,  and  the  n-th 
outcome  will  have  probability  pR.  This  procedure  can  even  be  used 
with  a  biased  coin,  with  unknown  bias,  by  counting  a  pair  of 


successive  tosses  as  one  unit,  giving  a  bit  of  "l"  if  first  heads,  then 
tails,  a  bit  of  "0"  if  first  tails,  then  heads,  and  being  inconclusive 
otherwise,  in  which  case  one  should  look  to  the  next  pair.) 

It  follows  then  that,  for  an  operational  concept  of  value,  the 
players  should  be  able  to  construct  e-optimal  strategies  where,  in 
each  information  set,  they  are  restricted  to  discrete  mixtures. 

In  particular,  for  general  minmax  theorems,  for  normal  form 
games,  which  may  represent  games  with  a  single  information  set,  one 
is  led  to  the  requirement  of  e-optimal  discrete  mixtures.  Under 
our  assumptions,  the  players  have  e-optimal  finite  mixtures,  and  the 
guaranteed  payoff  varies  continuously  with  the  probability  vector 
used,  so  in  any  realistic  model  the  player  can  play  e-optimally, 
even  in  bounded  time. 

(c)  More  important  is  the  "safety"  consideration,  that,  even 
neglecting  the  above,  the  player  should  always  consider  that  his  opponent 
might  have  an  infinity  of  information  sets  at  his  disposal,  or  sane 
analog  device  such  as  a  continuous  roulette  wheel,  and  thus  would  be 
able  to  generate  continuous  random  variables.  In  such  a  case,  the 
evaluation  of  the  expected  payoff  (even  if  players  agree  on  seme  compact 
topologies  on  S  and  T,  and  to  use  only  integration  theory  for  regular 
Borel  measures  on  compact  spaces)  would  depend  on  the  order  of  integration 
-  except  if  one  knows  in  addition  that  Fubini's  theorem  holds  for  the 
payoff  function.  For  instance,  players  may  think  that  the  corollary 
sub  (B)  in  the  proof  is  the  good  minmax  theorem;  given  a  payoff  function 
that  would  satisfy  those  assumptions  for  both  players,  player  I  might 
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find  an  optimal  strategy  that  "guarantees"  him  +1,  and  similarly, 
player  II  applying  the  same  corollary  for  him  might  find  an  optimal 
strategy  that  "guarantees"  to  him  that  the  payoff  will  not  exceed  -1. 
Obviously,  realizing  this,  both  players  can  only  conclude  that  the  only 
thing  they  really  can  guarantee,  is  what  they  can  guarantee  with  mixtures 
with  finite  support.  Since  "-1"  is  always  <_  to  "+1"  this  argument 
is  perfectly  general.  (By  our  theorem,  one  could,  in  this  example, 
have  a  strict  inequality  only  for  unbounded  payoff  functions;  but  still, 
the  theorem  is  needed  for  that,  and  anyway  the  argument  remains,  since 
it  depends  only  on  the  weak  inequality  -1  £  +1.) 

And  things  can  be  much  worse,  because  nothing  compels  the  player 
to  agree  on  some  integration  theory  -  or  even  on  some  topology  for  the 
strategy  spaces.  You  could  even  happen  to  be  playing  against  hub ins 
and  Savage  [1965],  using  finitely  additive  randomizations .  In  such  cases 
only  finite  mixtures  remain  safe,  unambiguous,  and  devoid  of  arhit'-arines 
(i.e.  only  such  a  solution  depends  only  on  the  data  of  the  problem,  i.e. 
the  pure  strategy  sets  -as  sets-  and  the  payoff  function  -as  a  real 
valued  function  on  the  product  of  the  pure  strategy  sets). 

(d)  The  proof  shows  that  the  result  is  much  easier  to  get  for 
compact  metric  spaces.  Is  it  really  worthwhile  to  make  a  substantially 
bigger  effort  in  order  to  get  rid  of  the  metrisability  assumption? 

A  first  answer  would  be  that  this  simplifies  the  statement  of 
the  theorem  (one  can  drop  "metric"),  and  that  any  effort  in  a  proof 
is  worthwhile  if  it  leads  to  a  simpler  (and  more  powerful)  theorem. 


V  * 
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A  much  more  important  reason  is,  however,  that  in  any  game  where 
a  continuous  variable  can  be  observed  before  some  action  is  taken,  the 
strategy  spaces  are  nor. -met ri sable .  Certainly  one  does  not  want  to 
exclude  such  models  from  game  theory.  Besides  the  obvious  cases 
(observation  of  a  price,  or  a  quantity,  or  a  continuous  random  variable), 
this  would  also  exclude  any  differential  game  (time  being  a  continuous 
variable)  and  any  game  with  a  continuum  of  players  (just  to  define  its 
characteristic  function,  one  needs  the  value  of  a  zero  sum  game  between 
two  opposing  coalitions,  where  the  strategy  space  of  each  coalition, 
as  an  uncountable  product,  cannot  be  metrisable) .  Those  problems 
are  amply  documented  in  the  literature;  for  instance,  R.J.  Aumann  [ 196U ] 
suggests  the  use  of  behavioral  strategies  to  get  around  this  type  of 
problem;  in  other  contexts  (differential  games,  games  with  a  continuum 
of  players,  etc.)  various  other  restrictions  are  imposed  on  the  strategy  sets. 

Besides  the  inconvenience  of  requiring  additional  structure 
(a  topology,  or  a  measurable  structure),  as  was  discussed  in  the  previous 
point,  such  procedures  have  the  unpleasant  feature  of  restricting  the 
strategy  space  -for  instance,  an  arbitrary  pure  strategy  is  net  necessarily 
a  behavioral  strategy,  since  it  may  lack  the  measurability  requirement. 

For  a  minmax  theorem,  it  is  of  course  a  net  gain  if  one  can  show  that 
some  player's  (e)-optimal  strategies  have  in  fact  some  additional 
regularity  property;  however,  it  is  disturbing  when  it  is  only  shown 
the  the  strategy  is  safe  against  some  subclass  of  the  opponent's  strategies. 
Indeed,  the  opponent  should  ideally  not  even  be  assumed  to  follow  a 
strategy,  -he  is  just  playing-  and  one  would  like  the  minmax  theorem 


4 


( 
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to  have  essentially  the  same  force  as  in  the  perfect  information  case, 
i.e.  that  any  "play"  consistent  with  your  e-optimal  strategy  yields 
a  payoff  >_  v  -  e. 

U .  Other  Minmax  Theorems 

A)  Measure  Theory  (non-Hausdorff  compact  spaces) 

For  any  compact  space  S,  denote  by  C  the  convex  cone  of  bounded 
l.s.c.  functions  on  S,  and  let  E  =  C\C.  Denote  by  P  the  set  of 
monotonic  real  valued  sublinear  (i.e.  positively  homogeneous  of  degree 
1  and  subadditive  (p(x  +  y)  <_  p(x)  +  p(y)))  functions  on  C.  P  is 
ordered  in  the  usual  way  (p^  <  p2  iff  p  (f)  <_  Pg(f)  V  f  £  C) . 

Definition:  M(S)  is  the  set  of  minimal  elements  of  P. 

Lemma  1:  Tp  £  P,3  ii  6M(S):  ^  <  p. 

Proof:  V  p  £  P,  V  f  £  C  let  a  <_  0  be  such  that  f  ^  a. 

Then  Vq£P  s.t.  q  <_p:  p(f )  >_  q(f )  _>  q(«)  >_  -q(-a)  >  -p(-a) ,  so  that  the 
set  of  possible  values  q(f)  is  a  bounded  interval.  Zorn's  lemma 
then  yields  a  minimal  such  q. 

Lemma  2:  Any  p  £  M(s)  is  a  positive  linear  functional  on  E, 
satisfying 

p(f)  ■  inf  (p(g)  |  g  £  C,  g  >  f)  Vf£E  . 

Proof:  Let  p:  E  -*■  R  be  defined  by  the  above  formula.  Clearly 
p  is  real  valued  (if  f  >  a,  then  p(f)  _>  p(o)  _>  y(a)  >  -•) .  Further, 
p  is  obviously  monotonic  and  sublinear,  coinciding  with  p  on  C. 


v  -tJatA  <. 


The  Hahn-Banach  theorem  says  that  any  such  y  is  the  supremum 
of  a  family  of  linear  functionals.  Any  linear  functional  £  <  p  is 


positive  ,  because  <_  0  on  the  negative  functions.  If  there  was  a 


second  such  S,  say 

C,  one  would 

have  S ( f )  $ 

C(f)  for  some 

fee. 

Then  either  t,  or 

restricted 

to  C,  would 

be  some  element 

of 

P 

<  u ,  and  +  u ,  thus 

y  would  not 

be  minimal . 

Therefore  this 

C 

is 

unique,  and  thus  coincides  with  y:  y  is  a  positive  linear  functional 
on  E. 

Lemma  3:  M(S)  is  the  set  of  positive  linear  functionals  u  on 
E  such  that 

V  f  e  C  ,  y(-f)  =  inf  (y(g)  !  g  e  C,  g  _>  -f}  . 

Proof:  One  direction  is  given  by  Lemma  2.  In  the  other 
direction,  we  have  clearly  y  e  P,  thus  (Lemma  l)  3  v  e  M(S): 
v(h)f_n(h)  Vh  6  C.  Thus  v(-f )  ^  y(  -f )  =  inf  (y(g)|geC,  g>^  -f} 

>_  inf  (v(g)  j  g  €  c,  g  _>  -f}  =  v(-f )  (by  Lemma  2),  from  which  the 
equality  of  y  and  v. 

Lemma  U:  M(S)  is  the  set  of  regular  Borel  measures  on  S, 
i.e.  the  set  of  positive,  bounded,  countably  additive  measures  on  the 
Borel  sets  of  S  satisfying  y(A)  =  sup  (y(F)  |  F  £  A,  F  closed} 

=  inf  (y(0)  |  0  O  A,  0  open}  for  any  y-measurable  set  A. 

Proof:  Follows  from  a  standard  Daniell-type  extension  procedure. 
We  sketch  just  a  typical  sequence  of  steps: 
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•  Denote  by  LSC  the  set  of  l.s.c.  functions  with  values  in  R  U  {+*}, 
and  USC  =  -  LSC. 

Let  ux(f)  =  sup  (p(g)  |  -g  £  C ,  g  <_  f}  V  f  £  LSC 

Let  p*(f)  =  inf  { p  -^(g )  |  g  £  LSC,  g  >_  f}  for  any  R-valued  f. 

•  Lemma  2  implies  p *  =  u  on  E,  and  u*  =  P1  on  LSC. 

•  Dini's  theorem  implies  that,  if  f  S  LSC  is  filtering  increasing, 
then 

p*(lim  f  )  =  lim  y#(f  ) 
a  a 

•  It  follows  that  p*(f  +  g)  =  p*(f)  +  u*( g)  on  LSC. 

-  The  sublinearity  of  u*  follows  (avoiding  (+®)  +  (-»)  right-hand 
members,  and  using  the  convention  (o)  *  (<*>)  =  0). 

•  Finally  one  gets:  if  h^  is  any  increasing  sequence,  with 

lim  u*(h  )  >  then  p*(lim  h  )  *  lim  y*(h  ).  (It  is  sufficient  to 

n  n  n 

consider  p*(h  )  finite;  choose  f  G  LSC,  f  >  h  , 
n  n  n  —  n 

p*(f„)  <  p*(h  )  +  e  •  2  n.  Let  ty  =  sup  f.,  ij>  is  an  increasing 
n  —  n  n  ./  i  n 

i<n 

sequence  in  LSC  such  that  >  h  .  4*  -  max  (ty  ,  ,  f  )  implies 

n  —  n  n  n-l  n 

P*U_ )  +  W*(h  .)  <  p*U  )  +  p*(min  (f  ,♦  , ))  *  P*(*  +  min  (f  ,*  ,)) 

n  n-l  —  n  n  n-l  n  n  n-i 

=  y*(f  ♦  ♦_  , )  =  p*(f  )  +  p*U  . ),  thus  P*(4>  )  -  P#(h  ) 
n  n-i  n  n-l  n  n 

<  [p*(f  )  -  u#(h  )]  +  [p*(<J<  , )  -  p*(h  , )]  and  therefore 

~  n  n  n-l  n-l 

U#(4>  )  -  P*(h  )  <  l  [p*(f.)  -  u*(h.)3  <  e  l  2_i  <  e,  so  that 

n  n  ~i<n  1  1  “  i<n 

lim  p*(h  )  <  p*(lim  h  )  <  u*(lim  i|i  )  *  lim  p*T"4»  )  <  lim  p*(h  )  ♦  e) . 
n  ~  n  —  n  n  ~  n 

•  It  follows  that  p*,  restricted  to  indicator  functions,  is  an  outer  measure. 
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•  Let  L  =  {f  |  y*(f)  >  -®,  y*(-f)  >  -®,  y#(f)  +  y*(-f)  <_0}. 

By  the  sublinearity  of  y#,  L  is  a  vector  space  and  y*  is  a  linear 
functional  on  L.  Further  E  since  y*  coincides  with  y  on  E, 

and  in  addition  f  G  LSC,  y*(f)  <  00  implies  f  £  L. 

•  Since  for  any  open  sets  0  and  U,  IQ  S  L,  and  e  L,  we  have 

also  IoNuG  L,  so  we  get  y*(0)  =  y*(0  ^U)  +  y*(0\u).  Urns,  for 
any  set  A,  since  y*(A)  =  inf  {y*(0)  |  A  £  0},  we  get 

u*(A)  >_  y*( A  O  U)  +  y*(A\  U),  so  that  any  open  set  U  is  y*-measurable 
and  thus  all  Borel  sets  are  u*-measurable . 

•  The  formula  y(A)  «  inf  (y'0)  |  A  £  0,  0  open}  for  any  y*-measurable 
set  A  implies  y(A)  =  sup  (y(F)  |  F  C  A,  F  closed},  and  thus  the 
y*^neasurable  sets  are  just  the  completion  of  the  Borel  sets,  and  y 

is  a  regular  Borel  measure. 

.  Finally,  /fdy  =  y*(f)  first  for  the  convex  cone  spanned  by  the 
constants  and  the  indicators  of  open  sets,  by  linearity,  next  for  all 
f  G  LSC,  by  monotone  convergence,  and  therefore  for  all  f 
and  in  particular  all  f  6  E.  It  also  follows  that  L  =  L^(y). 

•  The  regular  Borel  measure  y  is  unique,  because  its  value  on  the 
open  sets  is  determined. 

•  Conversely,  clearly  the  integral  for  any  regular  Borel  measure  is  a 
functional  in  M(S). 

The  essential  results  of  this  section  are  summarized  in  the  following: 
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PropositK  Denote  by  M(S)  the  set  of  positive,  regular 

Bor el  measures  on  S.  Then: 

.  f  p  €  p  3  U  €  M{S) :  p  <  p  on  C  (Lemma  l). 

•  M(S)  is  a  convex  cone  (and  a  complete  lattice)  (immediate  from  Lemma  1). 

•  If  the  sum  of  2  positive  linear  functionals  on  E  is  in  M(S),  each 
one  is  also  (immediate  from  Lemma  3). 

.  Define  the  "weak* -topology"  on  M(S)  as  the  coarsest  topology  for 
which  / fdp  is  lowersemicontinuous  T  f  ^  C,  and  thus  for  all  l.s.c.  f. 
Bien  addition  and  scalar  multiplication  are  continuous,  points  are 
closed  and  all  sets  { p  [  y ( l)  =  X}  and  (p  |  p(l)  <_  X}  (X  >  0)  are 
closed  and  compact. 

Proof:  The  continuity  of  addition  and  scalar  multiplication  is 
imaediate.  {p}  is  closed  because,  if  p  is  in  the  closure  of  p, 
one  has  p(f)  £  p(f )  Vf  €  C,  thus  p  =  p  by  the  minimality  of  p. 

Since  all  constants  belong  to  C,  there  only  remains  to  prove 
the  compactness  of  {p  |  p(l)  <_  X}.  For  any  ultrafilter  on  this  set, 
let  $  denote  its  pointwise  limit  in  the  set  of  positive  linear  functionals 
on  E.  By  Lemma  1,  3v  Gm(S)  with  v  <_  $  on  C:  v  is  a  limit 
point  in  M(S). 

Note  that  the  above  applies  whenever  C  is  a  lattice  and  convex 
cone  of  bounded  functions  on  some  set  S,  containing  the  constants  and 
such  that  fj£  C,  <  f^+^  <_  0  implies  lim  f^  G  c,  and  lim  f^  >  -1 
implies  3i:  f^  >  -1.  The  Borel  sets  are  then  interpreted  as  the 
o- field  generated  by  C,  and  the  regularity  is  with  respect  to  the 


*■*« 


{f  <_  0}  (f  6  C)  as  closed  sets.  (Dini's  theorem  should  he  used  only  for 
sequences  then.) 

In  particular,  everything  applies  as  soon  as  S  is  countably 

compact  (any  sequence  has  a  cluster  point).  Compactness  only  yields 

the  additional  r-smoothness  property:  y(uO  )  =  sup  u(0  )  for  any 

a  a  a  a 

increasing  net  of  open  sets  0^. 

In  the  particular  case  where  S  is  Hausdorff,  i.e., 

Vf .  g  €  C  s.t.  f  >  -g  3h:  -g  £  h  <_  f ,  h  continuous,  the  above 
results  yield  Riesz'  theorem. 

We  now  obtain  also,  using  standard  techniques,  a  Fubini  theorem 
(the  same  theorem  and  proof  obviously  holds  for  arbitrary  products, 
finite  or  infinite;  the  minmax  theorem  is  however,  concerned  only  with 
products  of  two  factors.  The  contribution  of  the  theorem  is  obviously 
to  get  the  measure  on  the  Borel  o-field  of  the  product,  instead  of  the 
product  o-field) : 

Proposition  2:  Let  and  denote  two  compact  spaces, 

K  =  x  K Let  €  M(K  ) ,  u2  G  M(K  ).  Then 

(a)  There  exists  a  unique  p  £  M(K),  denoted  p^  ®  p0,  such 
that  y(F1  *  Fg)  =  ^^^(Fg)  V  F^  closed  in  K^. 

(b)  For  any  lowersemicontinuous  f,  there  exists  a  sequence  of 

functions  if>.  =  e.  I  .  .  with  e .  >  0,  F*  closed  in  K  ,  and  a 

1  1  FxF1  1  J  d 

1  2 

constant  function  iji^  <_0,  such  that 

l  'II  1  f  and  Jfdp  =  IJty&u  . 
i  1  1 

(c)  For  any  p-quasi-integrable  f  one  has  that 

-  for  p^-  almost  every  x,  f(x,.)  is  p2~quasi-integrable. 
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~  /  f(x,y)dy2(y)  is  p^-quasi-integrable  (and  l.s.c.  if  f  is) 
-  /[/f(x,y)dp2(y)]dp1(x)  =  /f  dp. 

(An  extended  real  valued  function  f  called  p-quasi-integrable  if  it 
is  u-measurable  and  either  /f+dp  *  <*>  or  Jf”dp  *  «) . 

Proof :  Denote  by  p  the  product  measure  on  the  product  of 
the  Borel  o-fields;  let  p  be  a  positive  linear  functional  on  all 
bounded  functions  that  extends  /(.) dp,  and  let  (Lemma  l)  p  €  M(K) 
minorize  p  on  C .  Then  we  have 

w(©i  ><o2)  <.  pto-j^  x  o2)  *  u(ox  *  o2)  *  m1(o1 

for  all  open  in  K^,  and 

p(F1  x  F2)  >  p(Fi  x  F2)  =  p(F1  x  F2)  =  p1(F1)p2(F2) 

for  all  F.  closed  in  K. . 

1  1 

Using  the  regularity  of  p^,  it  follows  that,  for  any  un¬ 
measurable  sets  Ai#  iI(A  *  A2)  =  p  (A  )p  (A  ). 

Thus  the  product  measure  p  can  be  extended  to  a  regular  Borel 
measure.  By  the  regularity  of  p^  and  p2»  any  Borel  measure  p 
satisfying  u(F1  x  F?)  =  ^(F^p^F,,)  will  satisfy 
p(A^  x  Ag)  i  ^(^^2^2)  for  Borel  sets  A^,  and  thus  going 
to  complements,  the  inverse  inequality:  it  vill  be  an  extension 
of  p.  Since  any  open  set  0  is  the  limit  of  the  increasing  net 
of  sets  0o„  where  the  sets  0a  are  all  finite  unions  of  products 
0  x  02  Co,  and  thus  p-measurable,  the  regularity  of  p  will  imply 
that  p  is  uniquely  determined  on  all  open  sets,  and  thus  on  all 


Borel  sets. 


IJiis  proves  statement  (a),  and  (b)  is  obtained  by  pursuing  a 

bit  the  same  argxment  (representing  the  0^  as  finite  disjoint  unions 

of  products  of  Borel  sets,  and  using  there  the  regularity  of  the  y  's, 

going  from  indicator  functions  of  open  sets  to  l.s.c.  functions  f, 

one  obtains  a  finite  sequence  <1k  with  ^ .  <_  f  and  ][/ty.dy  as 

i 

close  as  required  to  Jfdy.  Iterating  this  conclusion  with  the  l.s.c. 

function  f  -  JiJk  yields  (b)). 

(c)  is  proved  by  first  noting  its  truth  when  f  =  Iq  ,  next, 

a 

using  the  regularity  of  all  measures,  that  it  remains  therefore  true 
for  indicators  of  open  sets,  and  hence  for  all  lowersemicontinuous  f. 
The  general  statement  follows  then  because,  for  any  quasi-integrable  f, 
Jfdy  =  inf '{/gdy  |  g  l.s.c.  >_  f }  =  sup  {/hdy  |  h  u.s.c.  <_  f};  this 
was  proved  in  Lemma  1*. 

B)  A  Basic  Tool 

We  return  now  to  the  corollary  sub  (B)  of  our  rainmax  theorem, 

dropping  the  Hausdorff  assumption  on  S.  Remark  that,  for  any  t  with 

finite  support,  f(s,r)  is  u.s.c.  in  s;  it  therefore  achieves  its 

maximum,  and  max  f(s,-r)  =  max  f(o,T).  Let  v  =  inf  max  f(a,x) 

3  a^MCS)  t  a 

(t  ranging  over  probabilities  with  finite  support).  By  part  (A)  of 

the  proof  there  exists,  for  any  finite  subset  T  of  T,  a 

probability  a  with  finite  support  on  S  such  that 

min  f(o,t)  >_  v.  Since  f(.,t)  is  u.s.c.,  and  o  is  a  positive 

tef 

linear  functional  on  E,  there  exists  by  Lemma  1,  a  €  M(S)  with 
o(g)  >_  o(g)  for  all  u.s.c.  g.  In  particular,  5(1)  =  a(l)  *  1, 


£«,  is  obviously  closed  in  M(S),  thus,  by  Proposition  1,  the  sets 

T 

form  a  decreasing  net  of  nonempty,  closed,  compact  sets,  and  therefore 
have  a  nonempty  intersection.  Any  o  in  the  intersection  fills  the  bill. 

Observe  that  it  follows  from  this  that  we  can  phrase  the  assumptions 
of  that  corollary  in  a  fully  intrinsic  way,  using  Alexander's  subbase 
theorem: 

Theorem  2:  Denote  by  S  and  T  two  sets,  f:  S  *  T  -*■  R  U 
For  any  a  €  R  and  t  €  T,  let  ^  =  {s  £  S  |  f(s,t )  >_  a) .  If  the 
family  of  sets  S  has  the  finite  intersection  property,  and  if 

X  jCl 

M(S)  denotes  the  set  of  regular  Borel  probabilities  on  S  endowed 
with  the  coarsest  topology  for  which  the  functions  f(.,t)  (t£  T) 

are  u.s.c. ,  then 


max  inf  f(a,t)  =  inf  max  f(s,x) 
cjGm(S)  t^T 

Remarks: 

1)  The  finite  intersection  property  can  be  rephrased  as  asking 
that  any  pointwise  limit  of  pure  strategies,  i.e.  of  functions  f(s,.), 
be  dominated  by  some  pure  strategy,  i.e.  by  some  function  f(sQ,.). 

2)  This  property  is  substantially  weaker  than  the  usual 
compactness  assumption.  For  instance,  if  T  is  a  single  point,  it 
Just  asks  that  f(s)  attains  its  maximum. 

3)  Using  the  remark  after  Proposition  1,  it  is  sufficient  to 

ask  that  the  class  of  sets  S  be  countably  compact,  i.e.  that  any 

t  ,o 

countable  family  of  such  sets  has  the  finite  intersection  property.  In 


that  case  M(S)  becomes  the  set  of  probabilities  on  the  o- field 
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generated  by  the  functions  f{.,t),  regular  w.r.t.  the  countable 

intersections  of  finite  unions  of  sets  S  (in  particular,  if  S  with 

*  » 

its  coarsest  topology  is  countably  compact,  M(S)  is  just  the  set  of 
regular  Borel  probabilities  on  S). 

This  amounts  to  ask  that,  for  any  countable  subset  T  of  T, 
any  pointvise  limit  of  pure  strategies  be  dominated  on  T  by 

some  pure  strategy  Sq. 

U)  Given  the  above  measure  theory,  including  Fubini ,  essentially 
our  whole  proof  of  Section  2  would  go  through  without  the  Hausdorff 
assumption,  and  thus  give  the  corresponding  "intrinsic"  result. 

Indeed,  the  use  of  continuous  functions  in  part  "D"  has  nothing 
essential;  lowersemicontinuous  ones  would  do  as  well,  giving  a  reduction 
to  the  case  where  T  is  compact  with  countable  base,  in  which  case  the 
proof  sub  (C)  works  just  as  well.  The  only  troublesome  point  lies  in 
the  last  sentence  sub  (ii)  of  case  (D)  where  the  regularity  of  the 
topology  ("every  point  has  a  basis  of  closed  neighborhoods" )  seems  to 
be  used  in  an  essential  way. 

Anyways,  it  goes  through  if  one  assumes  that  one  of  the  spaces 
S  and  T  either  has  a  countable  basis  or  is  Hausdorff. 

C)  Other  Techniques  from  the  Literature 

Most  results  of  the  literature  (except  of  course  Sion’s)  are 
obtained,  or  are  at  least  obtainable,  by  applying  to  some  particular 
case  of  Theorem  2  one  of  the  two  following  generalization  techniques: 

l)  The  first  one  goes  back  to  Wald.  It  states  that,  if  for 
any  e  >  0  it  is  possible  to  find  subsets  S£  of  S  and  Tg  of 
T  such  that,  by  some  independent  argvment ,  the  game  restricted  to  Se 
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and  T  has  a  value,  and  such  that  Vs  £  S,  3s1  6  S  :  f(s,t)  < 

e  e  — 

f(s’,t)  +  e  ft  G  T  ,  and  similarly  Vt  £  T,  3t'  G  T  :  fs  6  S 
e  e  e 

f(s,t)  ^  f(s,t')  -  e,  then  the  given  game  has  a  value. 

2)  The  other  idea  is  based  on  Karlin,  and  amounts  essentially 
to  using  the  monotone  convergence  theorem,  or  Fatou's  lemma. 

For  instance,  after  applying  Theorem  2  to  some  game,  and  having 
found  the  value  v  and  player  I's  optimal  strategy  u,  one  looks  for 
sane  class  C  of  functions  $(s)  such  that  /< j>(s)di  _>  v.  Say  C 

contains  all  bounded  measurable  functions  that  are  minorized  by  some 
f(.,t)  (t  £  T)  and  their  convex  combinations,  and  also  the  limit 
of  any  decreasing  sequence  $  of  such  functions  (one  could  still  add 
all  functions  which  are,  for  any  regular  Borel  probability  y, 
in  the  equivalence  class  of  some  <J>£  C )— / . 

Then  any  game  f(s,t)  such  that  f  <_  f  and  V  t,  f(.,t)  £  C 
would  have  the  same  value  and  optimal  strategy. 

Usually  f  is  constructed  from  f  by  taking  the  smallest  u.s.c. 
function  majorizing  it,  but  sometimes  the  argument  has  to  be  applied 
both  ways. 

To  illustrate,  we  give  a  typical  application:  S  and  T  are 
compact  metric,  f  is  a  bounded  measurable  (i.e.  measurable  for  any 
product  measure)  function  on  S  *  T  such  that,  if  E  =  {(s,t)  |  f 
is  not  continuous  in  s  or  in  t  at  (s,t)},  then  Vs,  #{t  |  (s,t)  £  E)  <_  1 
and  Vt,  #{s  |  (s,t)  6  I)  <  1.  (Remark  that  measurability  would  follow 
for  Instance  if  we  had,  denoting  by  E  the  (F^)  set  of  points  of 
discontinuity  of  f,  V  s  {t|  (o,t)  €  £)  and  Vt  {s|(s,t)£E} 
are  at  most  countable. ) 
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Such  a  game  has  a  value. 


Indeed,  let  ^(sq,^)  =  lim  sup  f(s,tQ),  4>2(sQ,t0)  =  lim  inf  f(sQ,t). 


Consider  an  optimal  strategy  a  of  player  I  in  the  game  with  payoff 
f  V  ^  (Theorem  2).  V t^  £  T,  by  considering  an  appropriate  sequence 
t±  converging  to  t_,  one  can  have  lim  (f  V  4>  )(s,t.)  =  A  (f  v  <f>  )] 

i-voo  lie:  1 

(s,t_).  Thus,  by  the  above  argument,  say  in  the  form  of  Fatou’s  lemma, 

a  is  still  an  optimal  strategy  of  player  I  for  [<j>2  A  (f  v  <$>)],  guaranteeing 

the  same  value  v  and  player  II’ s  e-optimal  strategy  with  finite 

support  x  guarantees  the  same  v  for  (f  V  <J>,  ) . 

^  -L  _L 

Inverting  the  roles  of  the  players,  we  get  a  value  v 2  for 
both  f  11  ^  and  ( ^  V  (f  a  $  )],  an  optimal  strategy  x  for  II 
and  an  e-optimal  strategy  with  finite  support  for  I.  But 

V  (f  A  <t’2)  >_  4>2  A  (f  v  so,  by  applying  Fubini's  theorem  to 

a  ®  t  and  those  payoff  functions,  we  get  v^  v  .  Since 
f  v  ^  i  f  i  f  A  4>2,  we  have  v2  =  vn  =  v,  and  and  x^_  guarantee 

v  in  those  3  games,  so  in  f. 

Karlin's  "general  game  of  timing  of  class  II"  (Karlin,  [1959], 

Chap.  V,  Ex.  20),  falls  in  this  category. 

Similarly,  assume  S  and  T  are  compact,  and  f(s,t)  is 

bounded  and  Borel-measurable  on  S  *  T.  Assume  3  S°  C  s  and  T°  C  T 

such  that  f(s,.)  is  l.s.c.  on  T  for  s  £  S°,  f(.,t)  is  u.s.c.  on 

S  for  t  £  T°,  and  such  that  V  s  £  S  3s  £  with  lim  inf  f(s  ,t) 

n  n 
n-*» 

>_  f(s,t)  Vt  €  t,  and  that  it  G  T  3  tn  £  T°  with 

lim  sup  f(s,t  )  <  f(s,t)  Vs  £  S.  Then  this  game  has  a  value, 
n-H»  n 

and  both  players  have  e-optimal  strategies  with  finite  support  carried 
0  0 

by  S  and  T  respectively. 


Indeed,  Theorem  2  yields  a  value  v  for  the  game  on  S  x  T^, 
and  by  Fatou's  lemma,  player  I's  optimal  strategy  is  still  safe  against 
all  t  €  T.  Similarly  one  can  apply  Theorem  2  and  next  Fatou's  lemma 
to  the  game  on  *  T,  with  value  v.  Fubini's  theorem  applied  to  f 
and  the  product  of  the  optimal  strategies  yields  then  v  =  v,  hence 
the  result . 

C.  Waternaux  [1983]' s  "auxiliary  game"  is  of  this  type. 

Most  other  classical  examples  (like  ail  examples  in  Karlin 
[1950],  Restrepo's  "general  silent  duel"  or  Karlin's  "two  machine- 
gun  duel")  can  be  shown  to  have  a  value  by  the  same  technique,  applied 
in  a  more  or  less  similar  {ana  often  easier)  way. 
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Footnotes 


If  this  is  done,  the  resulting  class  C  is  identical  to  the 
set  of  all  functions  <j>,  such  that  In,  4>v(-n)  is  in  the  closed 
convex  hull  of  the  set  of  bounded  measurable  function  >  seme 
f(.,t),  in  the  space  of  all  bounded  universally  measurable 
functions  in  duality  with  the  space  of  regular  Bor el  measures 
on  S.  This  shows  that  our  technique  is  really  equivalent  to 
Karlin's  apparently  more  powerful  closure  methods  (Karlin,  [1950]). 

The  only  point  to  show  is  that  the  class  C  of  bounded  functions 
in  C  is  closed,  it  is  thus  sufficient  to  show  closedness  in 
u)  o(L<o(  vi  ),L1  (u) ) .  By  the  Krein-Smulian  theorem  on  weak*- 
closed  convex  sets,  it  is  sufficient  to  show  that  its  intersection 
with  any  ball  of  is  tCl^L,) -closed.  Since  the  Mackey 

topology  coincides  on  balls  of  with  the  topology  of 

convergence  in  measure  (this  result  of  Grothendieck  follows 
easily  from  Dunford-Pettis'  equiintegrability  criterion  for 
weak  compactness  in  L^),  it  follows  from  Egorov's  theorem  that 
it  is  sufficient  to  show  that  the  limit  of  any  uniformly  bounded 
a.e.  convergent  sequence  (gn)  in  C  is  in  C. 

There  is  obviously  no  loss  in  assuming  further  that  each  g 
is  larger  than  some  convex  combination  of  functions  f(.,t). 

Then  lim  sup  gfi  is  obviously  in  C . 
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